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SUMMARY 


This  report  addresses  the  specific  problem  of  the  resolution  of  incoherent 
weight  assessments  in  an  additive  multiattribute  utility  analysis.  The 
approach  taken  is  that  if  incoherencies  occur  because  actual  numerical 
assessments  are  too  precise,  then  it  would  be  useful  if  the  ramifications 
of  less  precise,  but  coherent,  information  were  made  clear.  Two  types  of 
information  are  considered.  First,  it  is  supposed  that  the  decision  maker 
can  order  the  attributes  on  the  relative  importance  of  the  weights.  The 
implications  of  any  given  ordering  are  shown  to  be  very  simply  analyzed. 
Second,  it  is  supposed  that,  in  addition,  inequality  assessments  can  be 
made  between  certain  pairs  of  weights.  The  analysis  demonstrates  the 
implications  of  these,  and  also  suggests  which  inequality  assessments  are 
likely  to  be  most  useful. 
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1.0  INTRODUCTION 


» 


I 


f  Much  attention  has  recently  been  paid  to  the  problem  that  arises  in  prac¬ 

tical  decision  analysis  when  a  decision  maker  fails  to  comply  with  the 
axiomatic  system  on  which  the  theory  of  decision  analysis  is  based. 

Lindley,  Tversky,  and  Brown  (1979)  coined  the  term  "incoherence"  to  describe 
this  phenomenon.  Part  of  the  unease  about  incoherence  seems  to  have 
been  brought  about  by  the  fact  that  many  decision-analytic  assessments  are 
necessarily  subjective,  and  so  difficult,  if  not  impossible,  to  verify. 

This  means  that  we  tend  to  believe  that  people  will  be  incoherent  whether 
the  property  has  been  observed  or  not. 

Previous  work  in  this  area  has  been  almost  exclusively  concerned  with 
probability  judgments.  There  have  been  three  approaches  taken  in  dealing 
with  incoherence,  which  are  based  on  one's  degree  of  conviction  about  the 
axiomatic  system  that  underlies  the  assessments.  At  one  extreme,  the 
axiomatic  system  is  assumed  to  be  correct,  but  the  "measurements" 
are  inconsistent.  The  problem  then  becomes  one  of  trying  to  use  the 
observed  measurements  to  provide  a  best  guess  at  the  "true"  measurement 
(Lindley  et  al.,1979;  Freeling,  1981a).  At  the  other  extreme,  the  axiom¬ 
atic  system  is  rejected  for  some  reason,  and  attempts  are  made  to  pro¬ 
duce  more  appropriate  systems.  Some  of  these  approaches  have  come  under 
the  heading:  "extended  theories  of  belief"  (Smith,  1965;  Dempster,  1968; 
Shafer,  1976;  Freeling,  1980).  Between  these  extremes  lies  the  approach 
that  accepts  the  axiomatic  system  as  an  ideal  system,  but  one  which  in  practice 
is  unattainable.  The  theory  states  that  a  solution  exists,  but  no 
algorithm  can  be  found  that  will  produce  the  solution.  In  this  case,  it 
is  useful  to  see  if  the  information  one  has  can  produce  any  insights  into 
the  problem,  and  perhaps  produce  a  useful  decision  aid.  Such  approaches 
often  use  the  phrase  "partial  information"  to  describe  them  (Potter  and 
Anderson,  1980). 
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In  this  paper,  we  consider  how  to  tackle  the  incoherencies  that  arise  in 
multiattribute  utility  analyses.  Furthermore,  the  consideration  is  limited 
to  additive  models  rather  than  multiplicative  models.  Multiattribute 
utility  analysis  is  an  increasingly  popular  tool  for  decision  analysts, 
and  more  often  than  not  additive  models  are  assumed  (e.g. ,  Edwards,  1977) . 

(A  recently  published  example  is  by  Snapper  and  Seaver  (1980).)  Two  sets 
of  numerical  assessments  are  required  in  such  an  analysis.  For  each  attribute 
defined,  the  options  under  consideration  must  be  scored  (which  scores  are  some¬ 
times  objective  and  sometimes  subjective) ,  and  then  weights  which  are  tymically 
subjective  must  be  assessed  for  each  attribute.  Incoherencies  can  arise  in 
both  sets  of  assessments,  but  this  paper  only  considers  incoherencies  in 
the  weights,  firstly  because  they  are  generally  the  more  difficult  and 
subjective  assessments  to  make,  and  secondly  because  incoherencies  in 
weights  are  more  readily  determined. 

We  assume  then  that  an  additive  multiattribute  utility  analysis  of  a  given 
problem  has  been  tackled,  that  ^a  set  of  attributes  and  a  set  of  options 
have  been  identified,  and  that  the  options  have  been  satisfactorily 
scored  on  each  attribute.  We  are  left  to  try  and  assess  weights  across 
each  attribute.  This  is  usually  done  via  a  pairwise  comparison  between 
attributes.  Obvious  incoherencies  arise  when  for  three  attributes,  i,  j, 
and  k,  comparisons  between  i  and  j  and  between  j  and  k  do  not  correspond 
with  the  comparison  between  i  and  k,  which  can  be  directly  computed  from 
the  other  two  comparisons.  Practitioners  will  usually  perform  some 
sensitivity  analyses  on  the  weights,  but  computerized  sensitivity  analyses 
tend  to  be  rather  simple,  and  manual  ones  very  laborious. 

In  examining  ways  to  approach  the  incoherencies  that  arise  in  this  sort 
of  analysis,  we  could  take  any  of  the  three  paths  that  were  outlined  above. 

The  axiomatic  system  for  multiattribute  decision  analysis  has  been  criti¬ 
cized  (e.g.,  Rivett,  1972),  but  it  is  fair  to  say  that  although  alterna¬ 
tive  procedures  have  been  suggested,  compelling  alternative  axioms  have 
not  been  forthcoming.  The  arguments  rather  complain  that  the  axiom  sys¬ 
tem  is  too  demanding. 
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Instead,  then,  we  look  at  the  possibility  of  accepting  the  decision-analytic 
axioms  as  an  ideal  system,  but  assume  that  the  decision  maker  is  not  able 
I  to  meet  the  demands  that  the  system  imposes.  An  approach  that  takes  a  set 

of  incoherent  weight  assessments  and  provides  a  set  of  coherent  ones  has 
been  suggested  by  Freeling  (1981a) .  The  problem  with  such  an  approach  is 
that  it  can  be  very  difficult  to  explain  to  the  decision  maker  exactly  why 
^  a  certain  set  of  assessments,  that  were  not  directly  obtained,  should  be 

used  instead  of  a  directly  obtained  set.  This  is  a  serious  problem, 
because  the  purpose  of  a  decision  analysis  is,  in  our  view,  to  provide 
the  decision  maker  with  an  understanding  of  the  problem  and  the  issues 
f  that  are  at  stake  in  it,  rather  than  to  produce  an  optimal  decision,  as 

does  an  optimization  routine.  We  therefore  consider  looking  at  the  kind 
of  partial  information  that  a  decision  maker  might  both  feel  confident 
about  and  be  coherent  about;  and  see  what  this  information  might  have  to 
f  say  about  the  decision,  and  how  it  might  be  easily  presented. 

In  order  correctly  to  link  the  weight  assessments  with  the  scores,  weights 
are  usually  obtained  by  pairwise  comparison  between  attributes  that  have 
f  been  scored.  If  we  accept  that  such  assessments  of  weights  are  (at  least 

potentially)  incoherent,  what  information  might  we  expect  to  be  coherent? 

A  very  simple  statement  about  two  attributes  is  that  one  should  be  weighted 
higher  than  another.  This  is  an  ordinal  rather  than  a  cardinal  ranking, 
t  and  is  one  which,  we  believe,  can  be  made  quite  confidently  in  such  analy¬ 

ses.  The  first  assumption  we  shall  make,  then,  is  that  the  decision  maker 
is  able  to  rank  the  attributes  in  order  of  weight  size.  It  will  also  be¬ 
come  apparent  that  the  analysis  will  help  considerably  in  studying  the  pro- 

♦  blem  where  the  relative  positions  of  two  attributes  are  not  known  with  com¬ 
plete  confidence. 

In  addition  to  this  information,  it  is  likely  that  the  decision  maker 

♦  will  be  able  to  make  certain  quantitative  statements  about  the  pairwise  assess- 
-  ments.  In  a  similar  approach  to  that  adopted  in  the  subjective  probability 

assessment  literature  (see  Freeling,  1981b,  for  a  discussion  of  these),  we 
assume  that  although  a  point  assessment  will  not  be  coherent,  the  subject 

♦  can  place  upper  and  lower  bounds  on  the  assessment.  However,  we  shall  not 


t 
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_  ail  oairs  of  assessments.  Rather,  our 

insist  that  this  can  be  done  for  al  p 

to  see  what  can  done  with  given  assessments, 
investigations  will  be  to  see  wnat 

suaaest  which  assessments  are  most  important. 


\ 


1-4 


2.0  ANALYSIS 


In  this  section,  we  consider  how  one  might  incorporate  in  an  analysis 
two  sorts  of  information  that  might  be  forthcoming.  The  additive  multi¬ 
attribute  problem  is: 


maxZw.u. . 
.  .  i  13 


where  w^  is  the  weight  on  attribute  i,  and  u_  is  the  score  of  option 
j  on  attribute  i,  assumed  to  be  known  explicitly.  Note  that  if  the  w^ 
were  known,  we  could  simply  perform  the  maximization.  First,  we  demon¬ 
strate  how  one  can  very  simply  incorporate  a  preference  ordering  over 
the  weights.  Second,  we  see  how  the  introduction  of  further  inequality 
constraints,  of  the  form  w  <  or  >Aw  can  also  be  incorporated  quite 
simply.  With  the  mathematical  formulation  developed  in  this  section, 
practical  considerations  using  an  example  will  be  highlighted  in  the 
next  section. 


2. 1  The  Effect  of  an  Ordering  on  the  Weights 

Suppose  that  the  decision  maker  is  able  to  provide,  in  addition  to  the 
inputs  already  mentioned,  a  consistent  ordering  over  the  weights  w^. 

This  means  that,  by  renumbering  if  necessary,  we  can  say  that  w^w^-  •  *>w  . 
Ideally,  we  might  hope  that  this  information  would  indicate  that  a  par¬ 
ticular  option  must  be  best,  but  failing  that,  it  could  be  very  useful 
if  it  resulted  in  one  option  being  clearly  unfavorable.  In  a  choice 
between  two  options,  the  problem  of  discovering  whether  one  option  is 
preferred  to  the  other  whatever  the  weights  are,  supposing  only  that  they 
satisfy  the  inequality  constraints  above,  can  be  illuminated  by  considering 
the  following  linear  program: 

n 

Maximize  E  w. (u.  -u..) 

i=1  1  ID 


2-1 


subject  to: 


w 


1 


>  w 


2 


and 


w  <| 

n-1 


>  w 

n 


Zw,  =  1. 

i 


If  this  maximum  is  less  than  zero,  then  option  j  must  be  preferred  to  k 
for  any  allowable  weights.  Similarly,  if  the  minimum  of  the  same  objective 
function  were  always  greater  than  zero,  then  k  must  be  preferred  to  j  for 
any  allowable  weights.  In  other  cases,  we  cannot  make  any  preference 
statement  between  the  two  options,  and  this  presents  a  problem.  This 
analysis  does  not  indicate  what  region  in  the  allowable  space  will  pro¬ 
duce  positive  or  negative  scores  on  the  objective  function.  The  problem 
is  complicated  further  if  ther^  are  more  than  two  options.  In  this  case, 
a  given  option  (option  1  say)  cannot  be  best  if  some  convex  combination 
of  the  other  options  is  better  than  it  for  any  allowable  set  of  weights. 

For  in  this  case,  we  know  that  for  any  allowable  set  of  weights  there  is 
always  one  option  that  is  better  than  option  1. 


Mathematically,  we  wish  to  see  if  there  exists  some  x  ^ ,  j*=2,  ...;m,  where 
x.  >  0  for  all  j,  and  Zx.=l,  such  that: 

3  j  3 


n 


Z  w.  (u 
i=l  1 


il 


m 

Z  x  ,u . 


.) 
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is  less  than  zero  for  any  allowable  set  of  weights  w^.  This  is  a  much 
less  simple  linear  program. 


It  would  be  much  more  illuminating  if  we  could  find  a  procedure  which 
made  the  question  of  dominance  little  more  than  a  matter  of  inspection. 

We  can  do  this  by  reformulating  the  problem  is  such  a  way  that  the  order¬ 
ing  constraints  on  the  weights  effectively  can  be  hidden  in  the  formulation, 
thus  allowing  for  simple  intuitive  analysis  of  the  problem.  We  can  "hide" 
the  ordering  conditions  by  rewriting  the  formula  Zw^u^  (suppressing  the  option 
subscript  j  for  convenience)  as  follows: 
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a. 


n  u . 

Iw.u.  =  nw  Z  — 
11  n 


+  . . .+  j (w.-w  ) 

D  D+l 


3  Ui 
Z  — 
n  3 


.  +  (w. 


•W2)U1 


Now,  define  or  and  v^  as  follows: 


and 


and  we  have  that: 


a.  =  i{w.-w.  ,)  for  i<n 
l  i  i+l 

a  =  nw 
n  n 


Ew.u.  =  Ea.v. 
ii  li 


Furthermore,  it  is  easily  verified  that  the  or  are  true  weights,  in  that 
they  are  all  positive,  between  0  and  1,  and  they  must  sum  to  1.  Moreover, 
each  or  can  attain  its  maximum  of  1  and  minimum  of  0.  The  latter  will  be 

To  prove  that  the  maximum  is  1,  and  can  be  attained. 


true  if  w.  =  w.  . . 

l  i+l 

note  that  if  j{w.-w  )  >  1,  then  w.>w  +i/j.  But  because  w  >  w  ...  ^  w  , 
3  D+1  j  3  3  •  i  +  3 

the  maximum  value  of  w .  is  1/j,  as  Z  w.<.l,  which,  with  w  .  >.  0,  provides 

3  i=l  1  3 

a  contradiction.  By  the  same  token,  j  j — w j -+-1 3  =  ^  ho-'-ds  only  if  wj+l  = 

It  can  be  further  verified  that  the  equality  will  hold  if  vr  =  1/j  for  i  =  1 
to  j,  and  w^  =*  0  for  i  >  j.  Note  also  that  the  new  "score,"  v_.  is  the 
average  of  the  first  j  old  scores. 


The  converse  expressions  for  w.  and  u.  are: 

ii 


and 


w , 

i 


n 

Ear  /  j 


=  iv^- (i-1) v^_^  for  i>l. 


We  can  also  demonstrate  that  an  option  can  never  be  best,  if  and  only  if 
that  option  is  strictly  dominated  by  some  convex  combination  of  the  other 
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options  in  a  v  space.  First,  suppose  option  1  is  strictly  dominated  by 
a  convex  combination  of  the  other  options.  This  means  that  there  exist 
Xj,  j-2 , ... ,mr  Xj  >0  and  Ex^=l  such  that: 


v  <  Ex  v  for  all  i,  i=l,...,n. 

Now  suppose,  that  there  exists  a  set  of  a ,  i=l, . 
is  preferred  to  all  other  options,  i.e., 


.  n  such  that  option  1 


Z0tiVil  >  l0tiVij  f°r  a11  3'  3=2,...  ,m. 

Multiplying  each  of  these  inequalities  by  x_^ ,  and  summing,  we  obtain  that 

m  n  m  n 

Ex  .  lot .  v . ,  >Ex  .  Ea .  v .  . , 

2  31  1  11  2  31  1  13 

or,  on  rearranging,  that,  (as  £x .=1) , 

2  3 

n  n  m 

Ea.v..>Ea.Ex.v. . 

1  1  11  1  i2  3  13  ' 


so  that  (from  (1)): 


n  n 

Ea.v.,>Ea.v. , 

j  i  il  1  i  ll 


which  is  a  contradiction. 


Conversely,  suppose  that  option  1  is  not  dominated,  so  that  there  exist 
no  Xj  that  satisfy  (1).  Consider  the  space  of  attributes.  Let  y  be  the 
point  that  represents  option  1.  Let  X  be  the  set  of  points  that  repre¬ 
sents  all  convex  combinations  of  the  remaining  n-1  points.  Then  y  does 
not  belong  to  X.  Let  Z  be  the  union  of  X  with  all  points  dominated  by 
any  point  in  X.  Then  y  does  not  belong  to  Z,  and  Z  is  convex.  This  im¬ 
plies  that  there  is  a  supporting  hyperplane  defined  by  the  equation 

T  T 

8  x*c  that  divides  the  point  y  from  the  set  Z,  i.e.,  for  which  B  y>c 

T  T  T 

and  S  z<c  for  all  z  in  Z.  Hence,  3  y>B  z  for  all  z  in  Z.  From  our 
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choice  of  Z,  we  can  choose  z.  sufficiently  large  negative  so  that  if  0. 

T 

were  negative,  0  z  could  be  arbitrarily  large,  and  in  particular,  larger 
T 

than  0  y.  Hence,  each  0^  in  0  must  be  non- negative.  Let  be  the  nor¬ 
malized  equivalent  of  0^.  Then  we  have  proved  that: 


Ea.y.>Ea.z. 

i  i  ii 


for  all  z  in  Z,  and  in  particular  for  all  z  in  X.  That  is,  for  this  set 
of  a. ,  option  1  is  better  than  any  combination  of  all  other  options. 


Therefore,  in  order  to  see  what  information  about  the  relative  merits 
of  different  options  is  provided  just  by  information  about  the  order  of 
the  weights,  we  can  perform  the  transformation  described  above,  to  see 
if  any  of  the  options  are  now  dominated.  If  so,  then  those  options  can 
be  ruled  out.  If  not,  then  more  information  about  the  weights  is  required 
before  any  options  definitely  can  be  ruled  out. 


2.2  Inequality  Comparisons  Between  Attributes 

Suppose  now  that  the  decision  maker  has  been  able  to  provide  an  ordering 
over  the  attribute  weights,  but  that  there  are  still  at  least  two  options 
which  are  not  dominated.  We  can  now  demonstrate  how  we  can  incorporate 
inequality  comparisons  between  the  attributes  to  see  if  this  will  result 
in  any  options  being  discarded. 


2.2.1  A  single  assessment.  First,  consider  just  one  assessment.  Sup¬ 
pose  that  for  attributes  k  and  i,  where  k<£,  i.e.,  w^<wk»  we  have 

the  information  that  w  <.X  w  .  In  terms  of  the  a.,  this  means  that 

JC  IK  X 

n  n 

la./i  <  X.la./i 

k  1  1l  1 

At  first  sight  it  is  not  clear  what  this  condition  implies  for  the  a^. 
However,  let  us  reconsider  what  we  hope  to  achieve  by  obtaining  this 
information.  We  hope  eventually  to  show  that  one  option  is  to  be  pre¬ 
ferred  to  all  others.  It  would  be  useful,  then,  if  the  imposition  of 
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this  constraint  made  it  possible  to  rule  out  one  of  the  contending  options. 
In  ruling  out  one  of  the  contending  options,  what  we  have  to  show  is  that 
the  maximum  of  the  score  of  this  option  is  always  less  than  the  equivalent 
score  of  some  convex  combination  of  the  alternatives,  given  the  constraint 
as  was  shown  in  Section  2.1.  Algebraically,  we  hope  to  show  that  for  a 
given  option  which  we  may  call  option  1,  there  exists  some  convex  combi¬ 
nation  of  alternatives  such  that: 

n 

max  I  a.  (v,  . 

.  ,  i  li 

a.  i=l 
i 

subject  to  the  constaints: 


m 

r 


X  .  V  .  .  ) 

:  d1 


<  0 


£-1  n 

Za./i  <  (X..-1)  Za./i 
,i  "  1  *  i 


la.  =  1  (a.  >  0  for  all  i). 

i  i 

For  if  this  can  be  shown,  then  whatever  the  weights  are,  option  1  can 
never  be  best. 

This  is  a  linear  program,  and  we  can  use  many  of  the  standard  results  of 

linear  programming  to  analyze  this  problem.  In  particular,  we  can  observe 

that,  because  there  are  only  two  constraints,  a  basic  solution  will  have 

at  most  two  non-zero  a^.  There  are  three  possible  forms  to  the  solution 

of  this  problem.  Let  the  maximum  without  the  constraint  be  when  0^=1  for 

some  x.  Then  either  a  =1  satisfies  the  constraint,  in  which  case  the 

x 

maximum  does  not  change,  or  the  constraint  holds,  i.e.,  the  inequality 
can  be  replaced  by  an  equality  constraint  (by  complementary  slackness) . 

If  the  constraint  holds,  then  either  all  the  a.  in  this  constraint  are 

i 

zero,  in  which  case  there  exists  an  i  less  than  k  such  that  a.=l,  or  there 

i 

exist  i  and  j,  where  k<.i<£<j,  such  that  the  constraint  holds.  This  means 
that: 
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I 


1)  “i  {Xr1)aj,  and 


2)  a .  +  a .  =  1  • 
i  D 


The  first  expression  gives: 


(A1-l)ia. 


substituting  2) 


ja.  =  i(X.-l) (1-a.) 
1  1  x 


(j+i(X1-l))ai  =  i  (X1~l) 


KXj-l) 

ai  =  T(x1-i)+"j 


Similarly 


aj  i(X1~l)+j 


The  maximum  in  this  case  will  be: 


(X^DlA.+jA. 

KX^D+j 


where 


A.«v, Z  x.v. .. 
i  li  2  3  31 

If  this  maximum  is  less  than  zero,  then  we  know  that  option  1  cannot  be 
optimal.  Note,  however,  that  if  this  maximum  is  greater  than  zero,  then 
its  exact  value  is  of  little  interest.  This  prompts  a  simplification  of 
this  formula  for  ease  of  analysis.  For,  if  instead  of  finding  the  pair 
of  i  and  j  to  optimize  this  equation,  we  find  those  that  optimize  the 
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numerator,  and  because  the  denominator  is  always  greater  them  zero,  it 
follows  that  the  optimum  of  the  numerator  is  less  than  or  greater  than 
zero  if  and  only  if  the  optimum  of  the  whole  is  less  than  or  greater 
than  zero,  although  the  optimal  i  and  j  in  each  case  may  be  different. 

But  the  optimum  of  the  numerator  is  very  simple  to  find:  all  we  have  to 
do  is  find  the  i  such  that  k<i<£  and  iA.  is  maximized,  and  a  similar  j 
such  that  j>£  and  jA^  is  maximized.  There  is  still  the  problem  of  assess¬ 
ing  what  the  x_.  should  be,  especially  as  the  use  of  the  constraint  will 
depend  on  the  x^,  but  if,  as  is  most  simple,  the  x.  were  set,  particu¬ 
larly  if  x^  was  set  to  1  for  some  k,  the  analysis  would  become  quite  simple 

2.2.2  The  general  case.  Consider  now  the  case  where  there  are  several 
such  constraints.  For  a  given  objective  function,  we  know  from  ideas  of 
complementary  slackness  in  linear  programming  that  a  basic  solution  has 
exactly  one  non-zero  variable  for  each  constraint  that  is  met.  Consider 
then  just  the  constraints  that  are  met.  Such  a  constraint  is  of  the  form: 


l~  =  X  1-=- 
i  xy  i 
x  y 


Let  aix  be  the  first  non-zero  for  i  greater  than  or  equal  to  x.  Then, 
in  terms  of  the  non- zero  a^,  this  is  equivalent  to: 


ot.  a.  a.  a.  a. 

_4X  +_xxtl  +  _  A  (_J*+  ...+  _!*) 

i  ^  XY 


where  i  is  the  last  non-zero  a..  Now,  there  is  one  more  non-zero  variable 
e  i 

than  this  type  of  contraint,  the  summation  to  unity  being  the  extra  con¬ 
straint.  This  implies  two  things.  First,  if  we  consider  just  the  con¬ 
straints  except  the  summation  to  unity,  there  can  only  be  one  solution 
for  each  cu  in  terms  of  one  non-zero  a^.  Second,  because  of  the  type  of 
constraint  that  exists,  and  the  fact  that  they  are  now  equality  constraints 

we  can  find  constants  which  are  equivalent  to  X  ,  where  y=x+l,  and  are 

xy 

either  directly  obtained  from  a  constraint,  or  can  be  calculated  from  sets 

of  constraints,  and  are  the  ratios  between  w^  and  wx+^*  Define  ^x^x+1j 

to  be  X  .  Then,  X  can  be  rewritten  as  X  X  ,  X  , . 
x  xy  x  x+1...  y-1 
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r-v- 


» 


I 


We  are  now  in  a  position  to  verify  the  following  result: 


Theorem 


The  solution  to  this  set  of  linear  equations  has  a  solution  for  a. 
of  the  form: 


i  A  x  i 
x  e 


where  A  =  (X  -1) X  J , . , 
X  X  x+1 


Proof 


.X 

e-1 


It  will  be  verified  that  this  form  is  indeed  a  solution  to  the  set  of 
equations.  Remembering  that  the  general  equation  is  of  the  form: 


n  a.  n  a 

Z  -=■  *  X  E  -~ 

1  xy  1 
X  y 


and  that  X  =X  X  ....X  .,  the  theorem  will  hold  if  we  can  show  that: 

xy  x  x  *  -L  y  ™  X 


n  a.  e 

z  -i  =  nx. 

i  i 

x  x 


Consider  the  first  two  terms  of  the  left  hand  side  of  this  equation,  under 
the  hypothesis.  The  multiplier  of  the  term  is  A  +A  lf  and 

AX+AX+1  -  {(Xx‘1)Xx+l+(Xx+r1)}  x;2Xi 

=  (XxXx+l-1)  11  Xi  • 
x  x+2 

Now,  if  we  add  the  next  term,  we  can  see  that  in  like  fashion  ^x+2  will 
be  transferred  from  the  latter  product  to  the  former.  Finally,  by  ob¬ 
serving  that  A  *1,  we  can  see  that  in  the  end  the  -1  term  in  these  equa- 
e 

tions  will  disappear,  leaving  us  with  just  the  former  product,  i.e.. 


t 
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IIX . ,  as  we  were  trying  to  prove.  Thus  the  hypothesis  is  verified, 
x 

This  result  is  very  useful,  because  it  means  that  it  is  quite  easy  to 
analyze  good  basic  solutions.  For  example,  suppose  we  were  interested 
in  seeing  if  the  constraints  implied  that  one  option  was  worse  than 
another,  so  that  the  objective  function  is  of  the  forms 


max 

a. 


JL 


n 

E 

i=l 


ai(vli“v2i)* 


Letting  /^-v^-v  A »  the  actual  value  of  the  objective  funciton  for  this 
set  of  basic  solutions  is: 


E  A.  j.A. 

1  3i  1  3i 


eA.  j 


3i  A 


Again,  because  we  are  only  interested  in  whether  or  not  this  objective 
function  can  become  greater  than  zero,  all  we  need  do  is  look  at  the 
numerator  of  this  expression.  Furthermore,  it  becomes  quite  simple  to 
see  what  effect  the  addition  of  a  new  constraint  will  have  on  the  problem. 


This  provides  the  mathematical  underpinings  to  the  problem  of  analyzing 
the  two  sorts  of  information  that  we  have  suggested  to  be  worth  consider¬ 
ing  in  the  context  of  weight  assessment.  Considerations  of  practical 
interest  are  discussed  in  the  next  section. 
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3.0  AN  EXAMPLE 


> 


» 


In  order  to  see  why  the  above  analysis  can  be  of  help  to  decision  analysts, 
we  consider  a  practical  example*. 

The  scores  that  are  assumed  are  presented  in  Table  1.  Each  column  repre¬ 
sents  an  option,  and  each  row  an  attribute. 


TABLE  1 


0. 

X.  3 

1 

2 

3 

4 

5 

6 

7 

8 

9 

1 

1 

.715 

.800 

.875 

.760 

.780 

.885 

.740 

.945 

.935 

2 

.990 

.990 

.990 

.998 

.994 

.998 

.999 

.991 

.992 

3 

.791 

.791 

.782 

.622 

.457 

.457 

.726 

.778 

.898 

4 

.980 

.980 

.860 

.880 

.760 

.980 

1.000 

1.0C0 

1.000 

5 

.726 

.707 

.707 

.575 

.675 

.546 

.558 

.509 

.659 

6 

.958 

1.000 

.968 

.960 

.730 

.603 

.898 

.762 

.751 

Following  the  original  example,  the  ordering  over  the  weights  is 


assumed  to  be: 


w  >w  >w  >w  >w 
6  1  2  5  4  3 


Note  first  that  any  dominance  relations  in  Table  1  are  not  immediately 
apparent.  However,  by  making  the  transformation  of  Section  2.1  we  obtain 
the  new  table: 


*The  example  is  based  on  the  Nuclear  Power  Siting  Problem  of  Keeney  (1980) , 
which  although  not  an  additive  model,  provides  an  excellent  example.  The 
scores  presented  in  Table  1  were  gleaned  from  the  text  of  this  book. 

**N.B.  that  this  was  the  first  information  to  be  obtained  in  the  study. 


TABLE  2 


0. 
a.  3 

i 

1 

2 

3 

4 

1 

95.8 

100 

96.8 

96.0 

2 

83.7 

90.0 

92.2 

86.0 

3 

88.8 

93.0 

94.4 

90.6 

4 

84.7 

87.4 

88.5 

82.3 

5 

87.4 

89.5 

88.0 

83.5 

6 

86.0 

87.8 

86.4 

79.9 

5 

6 

7 

8 

9 

73.0 

60.3 

89.8 

76.2 

75.1 

75.5 

74.4 

81.9 

85.4 

84.3 

83.5 

82.9 

87.9 

89.9 

89.3 

79.5 

75.8 

79.9 

80.2 

83.4 

78.8 

80.2 

83.9 

84.4 

86.7 

73.3 

74.5 

82.0 

83.0 

87.3 

Here  the  scores  have  been  multiplied  by  one  hundred  for  convenience. 
Table  2  yields  a  number  of  obvious  dominance  relationships.  They  can  be 
categorized  as  in  Table  3: 


option 

1 

2 

3 

4 

5 

6 
7 
B 
9 


TABLE  3 


dominates 

5,6,7 


1,4,5, 6, 7, 8, 9 


1,4, 5, 6, 7, 8 


5,6 


5,6 

5,6 

5,6 


is  dominated  by 

2,3 


2,3 


1,2, 3, 4, 7, 8, 9 


1,2, 3, 4, 7, 8, 9 

1,2,3 

2,3 
2 


This  immediately  suggests  the  following  preference  structure: 


and  if  we  are  looking  for  only  one  option,  then  it  must  be  either  option  2 
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or  option  3.  Thus,  we  can  see  very  easily  exactly  what  implications 
can  be  drawn  from  the  information  about  the  preference  ordering  over 
the  weights.  In  this  case,  quite  a  staggering  amount  of  information 
is  obtained,  and  we  believe  that  this  is  likely  often  to  be  the  case  when 
the  number  of  options  is  similar  to  the  number  of  attributes,  or  larger. 

However,  this  analysis  does  not  give  us  the  complete  story,  and  so  we 
can  turn  to  the  second  part  of  the  analysis  to  see  what  further  informa¬ 
tion  will  help  us  to  decide  between  option  2  and  option  3.  Let  A^  be 
the  difference  between  the  score  on  option  2  and  that  on  option  3.  The 
information  we  shall  require  is  listed  in  Table  4: 

TABLE  4 


a-attribute 

w-attribute 

option  _ 

option  3 

L. 

X 

iA. 

X 

“l 

W6 

100 

96.8 

3.2 

3.2 

a2 

W1 

90.0 

92.2 

-2.2 

-4.4 

a3 

W2 

93.0 

94.4 

-1.4 

-4.2 

a4 

W5 

87.4 

88.5 

-1.1 

-4.4 

a5 

W4 

89.5 

88.0 

1.5 

7.5 

“6 

W3 

87.8 

86.4 

1.4 

8.4 

Note  that  because  some  of 

the  A .  are 

positive  and 

some  are 

negative 

is  possible  to  choose  combinations  of  the  a-attributes  so  that  either 
option  2  is  better  or  option  3  is  better.  In  order  to  be  able  to  dis¬ 
tinguish  between  these  options,  more  information  is  required,  and  so  the 
imposition  of  an  inequality  constraint  is  now  considered. 

In  what  follows,  we  do  not  pretend  to  perform  an  exhaustive  analysis  of 
the  use  of  inequality  constraints.  Rather  we  shall  use  the  example  to 
illuminate  some  useful,  and  hopefully  typical,  aspects  of  this  type  of 
information.  However,  it  is  likely  that  the  best  approach  will  vary  from 
problem  to  problem.  Returning  to  the  example,  then,  we  can  see  that  a 
comparison  between  w  and  w.  looks  useful,  as  the  corresponding  a-attributes 

O  1 
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have  a  large  difference  in  scores.  On  the  other  hand,  a  comparison  be¬ 
tween  w^  and  w^  would  be  of  little  use.  Suppose,  then,  that  we  are  given 

that  w  is  less  than  2.5  times  w  .  We  can  examine  the  effect  of  this 
o  1 

constraint  by  considering  the  two  linear  programs  which  maximize  and 
minimize  EA^,  respectively.  Considering  the  minimization  first,  without 
any  constraints  the  solution  is  to  let  a2=l.  solution  satisfies  the 


6  ou 

constraint  that  w,  <2.5w,  (which  is  that  a,  <1.5  E  /.  )  because  a  *0, 

.  61  1  ,=2  i  1 

so  that  the  constraint  has  no  effect  on  this  problem.  In  other  words, 
this  constraint  says  nothing  about  the  possibility  that  option  2  might  be 
better  than  option  3.  In  the  maximization  problem,  however,  the  free 
maximum  occurs  when  ot^=l,  and  this  does  not  satisfy  the  constraint,  so 
that  the  constraint  does  have  an  effect  on  this  problem.  An  opposite 
constraint  between  w  and  w  ,  will  similarly  affect  the  minimization 

O  1 

problem,  so  that,  for  example,  if  we  are  given  that  w  is  also  greater 

D 

than  1.5  times  w^ ,  then  mus^  be  allocated  a  certain  weight,  because 
we  have  that 


a2  >  .5 


6  a. 

E 

i=2 


'i 


Thus  the  pair  of  assessments  provides  one  useful  constraint  for  each 
problem. 


Recalling  the  analysis  of  Section  2,  if  a  constraint  of  the  form 

n  a.  n  a. 

E  V.  <  A  E  V. 

.  ,  i  .  ,  i 

1=3  i=k 

is  met,  then  a  basic  solution  will  consist  of  two  non-zero  a-attributes , 
one  between  j  and  k-1,  and  one  after  k-1.  Furthermore,  the  maximum  will 
be  positive  if  there  are  x  and  y  such  that  (A-l)xAx  +  yAy  is  positive, 
and  j<x<k,  y>k.  Now,  by  taking  the  last  column  of  Table  4,  and  multi¬ 
plying  all  numbers  between  j  and  k-1  by  (A-l)  ,  we  can  very  easily  see  if 
a  positive  maximum  exists.  In  this  case,  we  have  j=l,  k*2,  and  A=2.5 
in  the  maximization  case,  and  j=l,  k=2,  and  A=1.5  in  the  minimization 
case.  The  new  figures  are  shown  in  Table  5,  with  the  third  column  being 
the  maximization,  and  the  fourth  the  minimization.  Looking  at  the  third 
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TABLE  5 


attribute 

w-attribute 

option  3  over  2 
{maximization) 

option  2  over  3 
(minimization) 

al 

w 

f. 

4.8 

1.6 

a2 

o 

W1 

-4.4 

-4.4 

a3 

W2 

-4.2 

-4.2 

a4 

W5 

-4.4 

-4.4 

a5 

W4 

7.5 

7.5 

a6 

W3 

8.4 

8.4 

column,  the  maximum  occurs  when  a,  and  Ot  are  non-zero.  Moreover,  all 

1  O 

basic  solutions  involving  two  non-zero  a-attributes  are  positive.  It 
can  be  shown  that  this  means  that  it  is  impossible  to  find  comparisons 
which  will  make  the  maximum  negative,  unless  a  reappraisal  is  made  of 
this  first  constraint. 

Inspection  of  the  fourth  column  reveals  that  the  minimum  occurs  when  the 
two  a-attributes  are  and  either  a 2  or  a 4-  In  this  case,  however,  there 
are  some  basic  solutions  with  positive  values,  namely  the  two  pairs 
a.,  ac  and  a  ,  a  .  Let  us,  therefore,  consider  this  column  further, 
that  is  we  are  looking  to  see  if  option  2  can  dominate  option  3.* 

We  can  see  that  in  order  for  the  objective  function  to  be  negative, 
we  must  take  one  of  ct^,  a^,  and  a ^  as  the  attribute  to  complement 
in  the  basic  solution,  so  that  a.  and  a,  must  be  zero.  This  suggests 

D  D 

that  a  useful  next  assessment  will  be  of  the  form  w^  <  Xw^,  which  will 
force  a  positive  value  on  one  of  a_  and  a  .  Suppose  that  in  this  case, 

D  D 

X  is  given  to  be  3.  Applying  the  analysis  of  Section  2  again,  we  can 
adapt  the  fourth  column  of  Table  5  to  include  this  constraint,  as  in 
Table  6.  Here  we  must  choose  one  a-attribute  above  the  top  line  (i.e., 

Oj) ,  one  between  the  two  lines,  and  one  below  the  bottom  line. 

*N.B.  If  it  is  shown  that  one  option  can  never  dominate  the  other,  with 
a  given  set  of  constraints,  it  does  not  necessarily  mean  that  domination 
will  occur  the  other  way.  To  see  this,  consider  Table  5  with  the  last 
two  scores  in  each  column  being  -4  each,  instead  of  7.5  and  8.4. 


> 
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TABLE  6 


attribute 

w-attribute 

option  2  over  3 

“l 

W6 

4.8 

a2 

W1 

-8.8 

a3 

W2 

CO 

1 

a4 

W5 

1 

00 

05 

a5 

W4 

7.5 

a6 

W3 

8.4 

It  is  simple  to  see  that  the  minimum  occurs  when  a^f  a2  or  a^,  and  a,, 
are  non-zero,  and  that  the  minimum  value  is  4. 8-8. 8+7 . 5=3. 5,  which  is 
positive.  That  the  minimum  is  positive  means  that  all  feasible  solutions 
are  positive,  so  that  option  2  dominates  option  3.  The  analysis  of  this 
problem  need  go  no  further,  because  enough  information  has  been  provided 
to  produce  a  best  option,  namely  option  2. 

Of  course,  one  would  not  expect  such  a  simple  analysis  to  succeed  in 
general,  but  we  can  use  the  example  to  illustrate  one  or  two  further 
points.  Firstly,  it  is  possible  to  anticipate  the  possibility  of  an 
assessment  providing  a  dominated  option.  For  example,  suppose  we  had 
obtained  the  first  assessment  in  the  example,  so  that  Table  5  had  been 
produced.  The  next  assessment  will  be  of  the  form  w^Aw^.  This  in 
turn  will  mean  that  the  minimum  will  be  when  a^,a2  or  “4'  and  “5  are 
non-zero,  and  the  minimum  value  will  be: 

1.6A  -  4. 4  (A-l)  +  7.5  =  11.9  -  2.8A 
11.9 

This  is  negative  if  A>  ■:Q,  i.e.,  if  A  is  greater  than  about  4.  It  is 

2  •  o 

often  likely  that  an  analyst’s  intuitions  of  the  problem  will  suggest 
whether  A  will  be  in  the  region  of  this  figure,  and  so  whether  domina¬ 
tion  can  be  expected  or  not. 
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Now,  suppose  that  a  further  assessment  was  necessary.  If  this  were  be¬ 
tween  w^  and  w^,  and  a  multiplier  A  were  obtained,  all  the  values  above 
that  of  the  row  would  be  multiplied  by  A.  Thus,  until  we  know  this  A, 
the  real  relation  between  the  8.4  of  the  last  row,  and  the  values  in  the 
higher  rows,  is  unknown.  However,  once  there  is  a  set  of  inequalities 
that  link  the  first  a-attribute  and  the  last,  further  assessments  will 
not  continue  to  multiply  up  the  value  of  the  first  ot-attribute.  We  will 
call  such  a  set  of  assessments  a  bounded  set  of  assessments,  because  it 
places  upper  bounds  on  all  the  values  for  any  further  assessments. 

Next,  consider  an  assessment  between  two  of  the  weights  in  the  middle 

band,  i.e.,  between  two  of  w^,  w^ ,  and  w<_.  Suppose  that  w^<2.5w^, 

and  that  the  next  useful  assessment  were  that  w  <1.5w„.  If  this 

I  2 

constraint  is  met,  it  effectively  means  that  the  implicit  ratio  between 

w_  and  w,  is  2. 5/1. 5  =  1.67.  The  new  a-value  for  is  thus  (1. 5-1) 1.67iA 
2  4  2 

and  for  a„  and  a,  are  (1.67-l)iA..  The  sum  of  these  two  multipliers 
3  4  l 

is  just  (2.5-1),  so  that  the  sum  of  the  two  new  values  is  just  a  weighted 
average  of  the  values  prior  to  the  assessment.  Note,  however,  that  none 
of  the  values  apart  from  these  three  will  change,  and  this  will  always 
be  the  case  once  the  set  of  assessments  becomes  bounded. 

Finally,  observe  that  the  assessments  that  have  so  far  been  considered 
have  been  simple  to  analyze,  because  the  constraints  and  multipliers  have 
been  specially  chosen.  Matters  would  become  more  complicated  if,  having 
made  the  first  two  assessments,  an  assessment  between,  say,  w  and  w 

O  J 

were  made.  In  the  first  place,  such  an  assessment  might  either  be  redund¬ 
ant,  or  else  make  another  constraint  redundant.  In  the  second  place,  it 
requires  much  more  effort  to  ascertain  whether  a  greater  than  or  less  than 
assessment  is  .••squired.  Such  redundancy  is  avoided  by  careful  selection 
of  assessments.  Alternatively,  it  should  be  possible  for  a  computer  to 
be  able  to  take  a  given  set  of  assessments  and  eliminate  any  redundancies, 
and  present  the  kind  of  table  that  the  user  can  easily  examine. 
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